Web Survey Bibliography
Grids are commonly used, particularly in web surveys, when multiple items share the same response options. Previous research has found that displaying multiple items in a single grid yields higher correlated responses and less item differentiation compared to using either fewer grid items per screen or having one single item per screen (Tourangeau et al, 2004, Yan, 2005, Toepel et al, 2009). Also, responses in a grid appear to be less consistent when the item definitions are reversed, although the difference is not significant (Callegaro et al, 2009). The aim of our study is to investigate how the number of grid items and screens affect response behavior and data quality given a large number of overall items (12). Users who opt into a survey linked from the Google Maps interface will be shown one of five grid format conditions from a split ballot experiment. Across all groups, users will be presented with only one grid per screen, but the number of screens and grid-items will vary; in the first group, users will be presented with one twelve-item grid, in the second group, two-six item grids, in the third group, three four-item grids, and so forth. Additionally, all twelve grid-items will be randomized across screens and all grids will be presented with the same fully labeled 5-point response scale. We hypothesize that the distribution of answers will differ across experimental conditions and drop-offs and item non-response will increase with larger grids. Additionally, we hypothesize that grids with more items will lead to more measurement error as indicated by a higher rate of inconsistency, especially when the meaning of some grid-items is reversed (i.e confusing vs. simple).
Conference Homepage (abstract)
Web survey bibliography (4086)
- Mixed-mode design and Mode Effect in Surveying Military Veterans; 2012; Wang, W., Morin, R., Parker, K.
- Assessing Measurement Equivalence and Bias of Questions in Mixed-mode Surveys Under Controlled Sample...; 2012; Klausch, L. T., Hox, J., Schouten, B.
- Maximizing Survey Participation for Retail Customers by Understanding Survey Mode and Incentive Preferences...; 2012; Cardador, J.
- How Likely?: Comparisons of Behavioral Intention Measurement Validity; 2012; Bremer, J., Thomas, R. K.
- Some Thoughts on a Framework for Statistical Inference from Nonprobability Samples; 2012; Santos, R.
- Addressed-Based Sampling - A Better Sample? Exploring the Benefits of Using Addressed-Based Sampling...; 2012; Ellis, J. M., Rexrode, D. L.
- Data Quality from Low Cost Data Collection Methodologies; 2012; Traugott, M. W.
- A Typology and Review of Web Evaluation Strategies; 2012; Wiggins, B., Romano Bergstrom, J. C., Turner, S.
- Drop-Off Point for Undergraduate Students on a Web-based Alcohol and Tobacco Use Questionnaire; 2012; Mitra, A.
- An Examination of the 2010 Census Be Counted Program and Its Effects on Census Coverage and Duplication...; 2012; Jackson, G. I., Wechter, K. M.
- Dual Frame Sample and Mixed Mode Survey Strategy for Improving Coverage Error; 2012; Tarnai, J., Pfingst, L., Solet, D.
- A Demonstration of a Multi-Platform Mobile Survey Application: SurveyPulseTM, by RTI International; 2012; Roe, D. J., Zhang, Yu., Keating, M.
- Turn that Frown Upside-Down: The Effects of Smiley Faces as Symbolic Language in Self-administered Surveys...; 2012; Libman, A., Smyth, J. D.
- To Weight, or Not to Weight, That is the Question: Survey Weights and Multivariate Analysis; 2012; Young, R., Johnson, D. R.
- Investigating the Impact of the Number of Grid Items on Web Survey Responses; 2012; Guo, F., Nunge, E.
- Effects of Progress Indicators on Short Questionnaires; 2012; Sedley, A., Callegaro, M.
- The JanDY Online Survey System; 2012; Kamstra, J., Henley, M., Johnson, M.
- The Detection and Effects of Data From Potentially Ineligible Participants in Online Survey Research...; 2012; Grey, J.
- Guidelines for developing a robust web survey; 2012; Naithani, P.
- Internet Mobility Survey Sampling Biases in Measuring Frequency of Use of Different Transport Modes; 2012; Diana, M.
- Bringing data from an online survey or spreadsheet into SPSS; 2012; Raftery, D.
- Using e-surveys to access the views of football fans within online communities; 2012; Gibbons, T., Nuttall, D.
- Coverage error in internet surveys Can fixed phones fix it?; 2012; Vicente, P., Reis, E.
- Exploring the impact of animation-based questionnaire on conducting a web-based educational survey and...; 2012; Chien, Y.-T., Chang, C.-Y.
- Marktforschung mit dem iPad-Panel von Axel Springer Media Impact; 2012
- Online and Paper-Based: A Mixed-Method Approach to Conducting a Needs Assessment Survey of Physicians...; 2012; Olatunbosun, T., Wu, C., Grewal, G., Lynn, B.
- The “frequency divide”: implications for internet-based surveys; 2012; Vicente, P., Reis, E.
- Effects of Personalized Versus Generic Implementation of an Intra-Organizational Online Survey on Psychological...; 2012; Mueller, K., Straatmann, T., Hattrup, K., Jochum, M.
- Web Surveys: Methodological Problems and Research Perspectives; 2012; Biffignandi, S., Bethlehem, J.
- Increasing Response Rate in Web-Based/Internet Surveys; 2012; Manzo, A. N., Burke, J. M.
- Open-ended Questions in Web Surveys: One Large vs. Ten Small Boxes; 2012; Keusch, F.
- Effects of Pagination on Short Online Surveys; 2012; Sedley, A., Callegaro, M.
- A Systematic Review of Studies Investigating the Quality of Data Obtained with Online Panels; 2012; Callegaro, M., Villar, A., Krosnick, J. A., Yeager, D. S.
- Exploring New Pathways to Survey Recruitment; 2012; Bilgram, V., Stadler, D.Jawecki, G.
- Understanding selection bias in a worldwide, volunteer web-survey; 2012; Tijdens, K., Steinmetz, S.
- Does Mode Matter? Initial Evidence from the German Longitudinal Election Study (GLES); 2012; Blumenstiel, J. E., Rossmann, J.
- The Representativity of Web Surveys of the General Population compared to Traditional Modes and Mixed...; 2012; Klausch, L. T., Schouten, B., Hox, J.
- Surveytainment 2.0: Why investing 10 more minutes more in constructing your questionnaire is worth considering...; 2012; Muehle, A., Tress, F., Schmidt, S., Winkler, T.
- Market research online community (MROC) versus focus group; 2012; Zuber, M.
- Data quality in MAWI and CAWI; 2012; Mavletova, A. M., Blasius, J.
- Time use data collection using Smartphones: Results of a pilot study among experienced and inexperienced...; 2012; Scherpenzeel, A., Sonck, N., Fernee, H., Morren, Me.
- Scrutinizing Dynamics – Rolling panel waves in theory and practice; 2012; Faas, T., Blumenberg, J. N.
- Do Mail and Internet Surveys Produce Different Item Nonresponse Rates? An Experiment Using Random Mode...; 2012; Millar, M. M., Dillman, D. A.
- Item Nonresponse in a Client Survey of the General Public; 2012; Israel, G. D., Lamm, A. J.
- Comparing Item Nonresponse across Different Delivery Modes in General Population Surveys; 2012; Lesser, V. M., Newton, L., Yang, D.
- Determinants of Item Nonresponse to Web and Mail Respondents in Three Address-Based Mixed-Mode Surveys...; 2012; Messer, B. L., Edwards, M. L., Dillman, D. A.
- Little experience with technology as a cause of nonresponse in online surveys; 2012; Struminskaya, B., Schaurer, I., Kaczmirek, L., Bandilla, W.
- Automatic Forwarding on Web Surveys – Some Outlines and Remarks; 2012; Selkaelae, A.
- Thinking, Planning & Operationalizing Empirical Mixed Methods Research Design; 2012; Ruhi, U.
- Continuous large-scale volunteer web-surveys: The experience of Lohnspiegel and WageIndicator; 2012; Oez, F.